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Abstract 

We present analytic computational tools that permit us to identify, in an auto- 
matic way, conservation laws in optimal control. The central result we use is the 
famous Noether's theorem, a classical theory developed by Emmy Noether in 1918, 
in the context of the calculus of variations and mathematical physics, and which was 
extended recently to the more general context of optimal control. We show how a 
Computer Algebra System can be very helpful in finding the symmetries and corre- 
sponding conservation laws in optimal control theory, thus making useful in practice 
the theoretical results recently obtained in the literature. A Maple implementation 
is provided and several illustrative examples given. 
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1 Introduction 

Optimal control problems are usually solved with the help of the famous Pontryagin maxi- 
mum principle ^7] , which is a generalization of the classic Euler-Lagrange and Weierstrass 
necessary optimality conditions of the calculus of variations. The method of finding op- 
timal solutions via Pontryagin's maximum principle proceeds through the following main 
three steps: (i) one defines the Hamiltonian of the problem; (ii) with the help of the maxi- 
mality condition one tries to express the control variables with respect to state and adjoint 
variables; (iii) the Hamiltonian system is written in terms of state and adjoint variables 
only and the solutions of this system of ordinary differential equations are sought. Steps 
(ii) and (iii) are, generally speaking, nontrivial, and very difficult (or even impossible) to 
implement in practice [21]. One way to address the problem is to find conservation laws, 
i.e., quantities which are preserved along the extremals of the problem. Such conservation 
laws can be used to simplify the problem [HI HI!- The question is then the following: how to 
determine these conservation laws? It turns out that the classic results of Emmy Noether 
[TH Ho] of the calculus of variations, relating the existence of conservation laws with the ex- 
istence of symmetries, can be generalized to the wider context of optimal control [U El I2B] , 
reducing the problem to the one of discovering the invariance-symmetries. The difficulty 
resides precisely in the determination of the variational symmetries. While in Physics and 
Economics the question of existence of conservation laws is treated in a rather natural way, 
because the application itself suggest the symmetries (e.g., conservation of energy, conser- 
vation of momentum, income/health law, etc - all of them coming from very intuitive 
symmetries of the problem), from a strictly mathematical point of view, given a problem 
of optimal control, it is not obvious and not intuitive how one might derive a conservation 
law. Therefore, it would be of great practical use to have at our disposal computational 
means for the automatic identification of the symmetries of the optimal control problems 
(HE]- This is the motivation of the present work: to present a Maple package that can 
assist in this respect. The results extend the previous investigations of the authors, done 
in the classical context of the calculus of variations [7J, to the more general and interesting 
setting of optimal control |17j . where the application of symmetry and conservation laws 
is an area of current research [5J 12H] • 

The use of symbolic mathematical software is becoming, in recent years, an effective 
tool in mathematics p5J. Computer algebra, also known as symbolic computation, is an 
interdisciplinary area of mathematics and computer science. Computer Algebra Systems, 
Maple as an example, facilitate the interplay of conventional mathematics with computers. 
They are, in some sense, changing the way we learn, teach, and do research in mathematics 
PP. They can perform a myriad of symbolic mathematical operations, like analytic differ- 
entiation, integration of algebraic formulae, factoring polynomials, computing the complex 
roots of analytic functions, computing Taylor series expansions of functions, finding ana- 
lytic solutions of ordinary or partial differential equations, etc. It is not a surprise that 
they are becoming popular in control theory and control engineering applications ^E] • Here 
we use the Maple 9.5 system to find symmetries and corresponding conservation laws in 
optimal control. The paper is organized as follows. In ^2)the problem of optimal control is 



2 



Paulo D. F. Gouveia, Delfim F. M. Torres 



introduced, the necessary definitions are given, and Noether's theorem is introduced. The 
method of computing conservation laws in optimal control is explained in §H1 and the Maple 
package is then applied in 21 for computing symmetries and families of conservations laws 
to a diverse range of optimal control problems. In ^we focus attention to the symbolic 
computation of conservation laws in the calculus of variations. The Maple procedures are 
given in £0 and we end 33 with some comments and directions of future work. 



2 Conservation Laws in Optimal Control 

The optimal control problem consists in the minimization of an integral functional, 

b 

/[x(-),u(-)] = J L(t,x(t),u(*))dt, (1) 

a 

subject to a control system described by ordinary differential equations, 

x(t) = ¥ »(t,x(t),u(t)), (2) 

together with appropriate boundary conditions. The Lagrangian L(-, •, •) is a real function, 
assumed to be continuously differentiate in [a, b]xl n xl m ; t G M the independent variable; 
x: [a, b] — > M. n the vector of state variables; u: [a, b] — > Q C ]R m , Q an open set, the vector 
of controls, assumed to be piecewise continuous functions; and ip: [a, b] xl" xK™ — > R n the 
velocity vector, assumed to be a continuously differentiable vector function. We propose a 
computational method that permits to obtain conservation laws for a given optimal control 
problem. Our method is based in the version of Noether's theorem established in jl] (see 
also [2*%]). To describe a systematic method to compute conservation laws, first we need to 
recall the standard definitions of extremal, and conservation law. 

The central result in optimal control theory is the famous Pontryagin maximum princi- 
ple which gives a necessary optimality condition for the problems of optimal control. 



Theorem 1 (Pontryagin maximum principle) // (x(-), u( )) is a solution of the op- 
timal control problem (Cp-fl), then there exists a non-zero pair (i/j q , "»/>(-)), where if)o < 
is a constant and if)(-) an n-vectorial piecewise ^-smooth function with domain [a,b], in 
such a way the quadruple (x(-), u(-), ip , i/>(-)) satisfies the following conditions in almost 
all points t in the interval [a, b]: 

(i) the Hamiltonian system 

OH 

x(t) T = Q-(t,x(t),u(t),i> ,i>(t)), (3) 
OH 

i>(t) T = - — (t,x(t),u(t),^ ,V(t)), (4) 
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(ii) the maximality condition 



H(t, x(t), u(t), Vo, = maxif (t, x(t), v, ^ *l>(t)), 

vo2 



(5) 



Hamiltonian 



H(t, x, u, ^o, VO = V^O, x, u) + ^ T • <p(t, x, u) . 



(6) 



Remark 2 T/ie right-hand side of equations (Gjj and Q) ; of the Hamiltonian system, rep- 
resent a row-vector formed by the partial derivatives of the Hamiltonian scalar function 
H with respect to each one of the components of the derivation variable. Equation is 
nothing more than the control system equation is known as the adjoint system. 

Definition 3 A quadruple (x(-), u(-), ^>o ; VK')) satisfying the Pontryagin maximum prin- 
ciple is said to be a (Pontryagin) extremal. An extremal is normal when if> ^ 0, abnormal 

»/V>0 = 0. 

Remark 4 Since we assume Q to be an open set, the maximality condition (J3J) implies the 
stationary condition 



OH 

—(t,x(t),u(t),if) Q ,if>(t)) = 0, te[a,b\. 



(7) 



Using the Hamiltonian system (jHJ)-(JI|, and the stationary condition (J7jL it follows that, 
along the extremals, the total derivative of the Hamiltonian with respect to t equals its 
partial derivative, t G [a, b] : 

d OH 

— ff(*,x(t),u(t),V> ,^(*)) = -^(t,x(t),u(t),Vo,^(*)). (8) 

Let us now consider a one-parameter group of C 1 transformations h s : [a, b] x R n x 
W m xlxR"^Rxl"x R m x W l of the form 



h s (t, x, u, ip , if)) = (h s t (t, x, ifj , if)), h£(t, x, ifj , ip),h s u (t, x, u, ip , i/>),h s ,(t, x, u, ip Q , if))) 



(9) 

which reduces to the identity transformation when the parameter s vanishes: 

h° t {t, x, ipo, if)) = t, h° (t, x, ^o, if)) = x, h° (t, x, u, ^o, */>) = u, hj(t, x, u, ip , if)) = if) . 

Associated with a one-parameter group of transformations we introduce the infinites- 
imal generators 





T(t t x,ifo,xl>)= —h s t (t,x,ip if)) 



0s 







XJ(t, x, u, if) , if)) = Q^K{t, x > u ! V>o, VO 



X(t,x,if) ,i/)) = — h s x (t,x,if) , if)) 




s=0 



s=0 



(10) 
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Emmy Noether was the first who established a relation between the existence of invariance 
transformations of the problem and the existence of conservation laws jHj. This relation 
constitutes a universal principle that can be formulated, as a theorem, in several different 
contexts, under several different hypotheses (see e.g. |UinjinilIDllISll2nil2Hl)- Contributions 
in the literature go, however, further than extending Noether's theorem to different con- 
texts, and weakening its assumptions. Since the pioneering work by Noether ^3], several 
definitions of invariance have been introduced for the problems of the calculus of variations 
(see e.g. |ID1 EH EDI EE!); and for the problems of optimal control (see e.g. |i| IH| 127]). 
All these definitions are given with respect to a one-parameter group of transformations 
(JDJ). Although written in a different way (some of these invariance/symmetry notions in- 
volve the integral functional, others only the integrand; some of them involve the original 
problem and the transformed one, others only the rate of change with respect to the pa- 
rameter; etc) it turns out that, when written in terms of the generators ([ID} , one gets a 
necessary and sufficient condition of invariance that, essentially, coincides with all those 
definitions. For this reason, here we define invariance directly in terms of the generators 

Definition 5 ([H I28j ) We say that an optimal control problem fcty-fiB) is invariant under 
(|10|) or, equivalently, that (fTU|) is a symmetry of the problem, if, and only if, 

<9# dH dH dH tT . lT dX AT , , 

— T + — -X + — -U + — x- ^ T . — + H— = 0, 11 

at ox du dip at at 

with H the Hamiltonian ([DJ). 

A symmetry is an intrinsic property of the optimal control problem (JT|)-P]) (an intrinsic 
property of the corresponding Hamiltonian (jDJ)), and does not depend on the extremals. If 
one restricts attention to the quadruples (x(-), u(-), tpo, that satisfy the Hamiltonian 
system and the maximality condition, one arrives at E. Noether's theorem: along the 
extremals, equalities (j3J), (jU), (J7J, and (jSj) permit to simplify (fTTj) to the form 

^ T _^T. x _^T.dX ^dT d , T _ T >x n =Q (12) 
dt v ^ dt dt dt v r ; y J 



Definition 6 A function C(t, x, u, ipo, ip) which is preserved along all the extremals of the 
optimal control problem and all t G [a, b], 

C(t,x(t),u(t), ipo,tp(t)) = const, (13) 

is called a first integral. Equation (fT3~j) is said to be a conservation law. 

Equation ()12j) asserts that C = HT — ip T ■ X is a first integral: 

Theorem 7 (Noether's theorem) If il(J\) is a symmetry of problem (CJ)-(0), then 

ip(tf ■ X(t, x(t), ifo, ip(t)) - H(t, x(t), u(t), fa, ip(t))T(t, x(t), Vo, ip(t)) = const (14) 
is a conservation law. 
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From expression (jTlj) we see that Noetherian conservation laws, associated with a certain 
optimal control problem, that is, with a certain Hamiltonian H(t, x, u, ipo,ip), only depend 
on the generators T and X of a symmetry (T, X, U, SI/) (flT)|) . 



3 Computation of Conservation Laws 



The conservation laws we are looking for are obtained by substitution of the components T 
and X of a symmetry of the problem in (j!4jh In sectionElwe introduce the Maple procedure 
Noether to do these calculations for us. The input to this procedure is: the Lagrangian 
L and the velocity vector ip, that define the optimal control problem ©-(0) and the 
respective Hamiltonian H; and a symmetry, or a family of symmetries, obtained by means 
of our procedure Symmetry (see the procedure Symmetry in The output of Noether 
is the corresponding conservation law (j!4j) . The non-trivial part of the computation lies in 
the determination of the symmetries of the problem (implemented in the Maple procedure 
Symmetry). Our algorithm for determining the infinitesimal generators is based on the 
necessary and sufficient condition of invariance (fTTj) . The key to do the calculations consists 
in observing that when we substitute the Hamiltonian H and its partial derivatives in the 
invariance identity (jllj) . then the condition becomes a polynomial in x and if), and one can 
set the coefficients equal to zero. Let us see how it works in detail. 

Substituting H and its partial derivatives into (JTTJ), and expanding the total derivatives 

dT _ dT + dT ±+ dT ^ dX _ <9X + oX ^ + ax • 
dt dt dx dip dt dt dx dip 

one can write equation (jllj) polynomial 

A(t, x, u, ip , ip) + B(t, x, u, ^o, ip) ■ x + C(t, x, u, 4> , ijS) ■ if) = 

in the 2n derivatives x and if): 



(15) 



fdH_ T dH dH 
I dt dx du 



+ 



H- 



dH 
dip 
dT 



"I 

dip 



- \ - iP 



0. (16) 



9x ox y 1 ^ 9i/> ^ 9^ / 

The terms in (j!6jl which involve derivatives with respect to vectors are expanded in row- 
vectors or in matrices, depending, respectively, if the function is a scalar or a vectorial one. 
For example, 



dT 
dx 

ax 

dip 



dT dT 



dx\ dx2 



<9X c>X 

dip\ di> 2 



dT 

dx n 



ax 

dipn 



dX 1 


dJCi 


dXi ' 


dipi 


dip2 




0X 2 


0X 2 


ax 2 


dipi 




dipn 


dX„ 


dX n 


dXn 


dtp! 


8ip2 


dipn 
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Given an optimal control problem, denned by a Lagrangian L and a control system (|2|L we 
determine the infinitesimal generators T, X, U and which define a symmetry for the 
problem, by the following method. Equation (jlfij) is a differential equation in the 2n + m+l 
unknown functions T, Xi, . . . , X n , U\, . . . , U m , &x, . . . , and W n . This equation must hold 
for all -0!, . . . , and therefore the coefficients A, 5, and C of polynomial 

()15|) must vanish, that is, 

^L T + — x + — u + — * + #^-</, T — -o 

<9t <9x 9u dtjj dt ' <9i 

-* T + ^-V T -f^ = 0, (17) 
ox ax 

H— - V> T — - 

9-0 dtp 

System of equations (fTTjl . obtained from (fTHjl . is a system of 2n + 1 partial differential 
equations with 2n + m + 1 unknown functions (so, in general, there exists not a unique 
symmetry but a whole family of symmetries - see examples in £01 an d ©■ Although 
a system of PDEs, its solution is possible because the system is linear with respect to 
the unknown functions and their derivatives. However, when dealing with optimal control 
problems with several state and control variables, the number of calculations is big enough, 
and the help of the computer is more than welcome. Our Maple procedure Symmetry, in ^ 
does the job for us. The procedure receives, as input, the Lagrangian and the expressions 
which define the control system; and gives, as output, a family of symmetries (T, X, U, St). 
Since system (IT?]) is homogeneous, we always have, as trivial solution, (T, X, U, \I/) = 0. 
This does not give any additional information (for the trivial solution, Noether's theorem is 
the truism "zero is a constant"). When the output of Symmetry coincides with the trivial 
solution, that means, roughly speaking, that the optimal control problem does not admit 
a symmetry (more precisely - see £0- it means that our procedure Maple was not able to 
find symmetries for the problem). 

Summarizing: given an optimal control problem (|T|) - P|) we compute conservation laws, 
in an automatic way, through two steps: (i) with our procedure Symmetry we obtain all the 
possible invariance symmetries of the problem; (ii) using the obtained symmetries as input 
to procedure Noether, based on Theorem [?l we obtain the correspondent conservation laws. 

In the next two sections we give several examples illustrating the whole process. 



4 Illustrative Examples 

In order to show the functionality and the use of the routines developed, we apply our Maple 
package to several concrete optimal control problems found in the literature. The obtained 
results show the correctness and usefulness of the Maple code. All the computational 
processing was carried out with Maple version 9.5 on a 1.4 GHz Pentium Centrino with 
512MB RAM. The computing time of procedure Symmetry is indicated for each example 
in the format min'sec". All the other Maple commands run instantaneously. 
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Example 8 (0'02") Let us begin with the minimization of the functional J L(u(t))dt sub- 
ject to the control system x(t) = (p(u(t))x(t) . This is a very simple problem, with one state 
variable (n = 1) and one control variable (m = l). With Maple definitions 

> l:=L(u); Phi:=phi(u)*x; 

I := L(u) 
$ := <p(u)x 

our procedure Symmetry determines the infinitesimal invariance generators of the optimal 
control problem under consideration: 

> Symmetry (1, Phi, t, x, u) ; 

{t = c 2 , x = dx, u = o,v = -Ci tj)} 

The family of Conservation Laws associated with the generators just obtained, is easily 
obtained through our procedure Noether (the sign of percentage - % - is an operator used 
in Maple to represent the result of the previous command): 

> Noether (1, Phi, t,x,u, %) ; 

Cix(t)ip{t) - (ip L (u(t)) + ip(t)<p (u(t)) x(t)) C 2 = const 

The obtained conservation law depends on two parameters. Since the problem is au- 
tonomous, the fact that the Hamiltonian H = ip$L (u(t)) + ip(t)tp (u(t)) x(t) is constant 
along the extremals is a trivial consequence of the property (JHJ). With the substitutions 

> subs(C[l]=l,C[2]=0, %); 

x(t)ip(t) = const 
one gets the conservation law obtained in WA Example 4]- 

Example 9 (1 '13") Let us consider now the following problem: 

b 

J ( Ul (t) 2 + u 2 {tf) dt — >min, 

Xi(t) = Ui(t) cosx 3 (t), 
x 2 (t) = Ui(t) smx 3 (t), 
x 3 (t) = u 2 (t), 

where the control system serves as model for the kinematics of a car Uty Example 18, 
p. 750]. In this case the optimal control problem has three state variables (n = 3) and two 
controls (m = 2). The conservation law for this example, and the next ones, is obtained 
by the same process followed in Example [3 

> L:=u[l] "2+u[2] "2; phi : = [u [1] *cos (x [3] ) ,u [1] *sin(x [3] ) ,u [2] ] ; 
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L := ui 2 + u 2 2 

ip : = [iiicos(x 3 ) ,nisin(x 3 ) ,u 2 ] 

> Symmetry (L , phi, t, [x [1] ,x [2] ,x [3] ] , [u [1] ,u [2] ] ) ; 



{T = C 2 , X 1 = -C x x* + C 3 , X 2 = dxi + C 4 , X 3 = Ci, 

U x = 0,U 2 = 0, *i = -Ci^j, ^ 2 = CiVi, ^ 3 = 0} 

> NoetherCL, phi, t, [x [1] ,x [2] ,x [3] ] , [u[l],u[2]], °/„) ; 



(-C lX2 (t) + C 3 ) Mt) + (Cixi(t) + C 4 ) ^(i) + Ci^ 3 (t) 
V>o f (ni(t)) 2 + (n 2 (t)) 2N ) cos (x 3 (t)) ^i(t)+m(i) sin (s 3 (t)) M^+M^s (*) ) ^2 = cons* 



Choosing Cx — 1 and C*2 = C3 = C4 = we obtain, from Theorem^ the conservation law 

> subs(C[l]=l,C[2]=0,C[3]=0,C[4]=0, 7„) ; 

-x 2 (t)4)x(t) + xx(t)ip 2 (t) + if>3(t) = const 

which corresponds to the symmetry group of planar (orientation-preserving) isometries 
given in 11 ifl Example 18, p. 750]. 

Example 10 (O'Ol") Let us return to a scalar problem (n = m = 1): 

e tx{t) u{i)c\t — ► min, x(t) = tx{t)u{tf . 

> L:=exp(t*x)*u; phi:=t*x*u"2; 

L := e tx u 
(p := txu 2 

> Symmetry (L, phi, t, x, u) ; 

{T = -tCx, X = Cxx, U = Cxu, V = -ip Cx} 

> Noether(L, phi, t, x, u, %) ; 

Cxx(t)ip{t) + (ip e tx{t) u(t) +if)(t)tx(t) (u(t)) 2 ) tCx = const 
By choosing Cx = 1 

> expand(subs(C[l]=l, %)); 
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x(t)ip(t) + tip e tx{i) u(t) + ij){t)t 2 x{t) (u(t)) 2 = const 
one obtains the conservation law of \25l Example 1]. 

Example 11 (6'41") We now consider an optimal control problem with four state vari- 
ables (n = 4) and two controls (m = 2): 



( Ul (t) 2 + u 2 (t) 2 ) dt 



mm, 



Xi(t) = x 3 (t), 
x 2 (t) = X A (t), 

x 3 {t) = -x.it) { Xl {t) 2 + X 2 {t) 2 ) + Ul (t), 

K x 4 {t) = -x 2 (t) (xi(t) 2 + x 2 {t) 2 ) + u 2 (t), 

> L:=u[l] ~2+u[2] ~2; phi : = [x [3] , x [4] , -x [1] * (x [1] ~2+x [2] "2) +u [1] , 

-x[2]*(x[l]~2+x[2]~2)+u[2]] ; 

L := ui 2 +u 2 2 

ip := [x 3 ,X4, -xi (xi 2 + x 2 2 ) + ui, -x 2 (xi 2 + x 2 2 ) + u 2 ] 

> Symmetry(L, phi, t, [x [1] ,x [2] ,x [3] ,x [4] ] , [u [1] ,u [2] ] ) ; 



{r = c 3 , X! = c lX2 , x 2 = -cixi, x 3 = Cix 4 ,x 4 
Ui ■. 



-Cix 3 , 



„ 1 (C 2 + d)^ 4 TT r , 1 (C 2 + gl) ^ 3 

<^2U2 - ~ ; , u 2 = C 2 ui + - - . 

2 ipo 2-00 



*1 = Ci^2, *2 = -Cxipx, * 3 = CiV>4, ^4 
> Noether(L, phi, t, [x [1] ,x [2] ,x [3] ,x [4] ] , [u[l],u[2]], %) ; 



-C 



dxzWM) - Cix^Mt) + cix 4 (t)^3(<) - Cix 3 (t)V4(t) - f^o (W*)) 2 + (Mt)) 

+ x 3 (i)V>i(*) + x 4 (t)%b 2 (t) + ((*i(*)) 2 + M*)) 2 ) + «i(t)) $,(t) 

+ (-Mt) ((xi(t)) 2 + (x 2 (t)) 2 ) +u 2 (t)) V4(t)JC 3 = cons* 



T/ie substitutions 

> subs(C[l]=-l,C[3]=0, %); 

-x 2 (t)\fji(t) + xi (t) ^ 2 (i) - Xi (t) ip 3 (t) + x 3 (t)tp4(t) = const 
conduce us to the conservation law provided in \21\ Example 5.2]. 
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Example 12 (6'42") Another problem with n = 4 and m = 2: 

b 

/ { Ul {tf + u 2 (t) 2 ) dt — > min, 

a 

' X 1 (t) = Ul (t) (1 + X 2 (t)) , 

x 2 (t) = ui(t)x 3 (t), 
xs(t) = u 2 (t), 

K x A {t) = U X {t)x 3 (t) 2 . 

> L:=u[l]~2+u[2]~2; phi : = [u [1] * (1+x [2] ) ,u [1] *x [3] ,u[2] ,u [1] *x [3] ~2] ; 

L := ui 2 + u 2 2 

Lp := [m (1 + x 2 ) ,u 1 x 3 ,u 2 ,uix 3 2 } 

> Symmetry (L , phi, t, [x [1] ,x [2] ,x [3] ,x [4] ] , [u [1] ,u [2] ] ) ; 

{r = | dt + C 2 , X X = CiSi + C 4 , X 2 = I d + I CiX 2 , ^3 = ^ CiX 3 , ^4 = Cl*4 + C 3 , 
Ul = -- WlCi, t/jj = - g ClU 2 , * 1 = -ClV'l, ^2 = - g Ci^ 2 , *3 = -g Cl^S, ^4 = -Cl^ 4 } 

> Noether(L, phi, t, [x [1] ,x [2] ,x [3] ,x [4] ] , [u[l],u[2]], %) ; 

(Cixi(t) + C 4 ) ^i(t) + Q Ci + | dx 2 (*)) V 2 (t) + ~ Cix 3 (t)^(t) + (Cix 4 (t) + C 3 ) Mt) 

- \fo (W*)) 2 + MO) 2 ) + Mt)Mt) (i + Z2(*)) + Mt)Mt)Mt) 

+ Mt)Mt) + ^4(<)«i(<) (Mt)) 2 ^ Ci* + C 2 j = const 

With the substitutions 

> subs(C[l]=3,C[2]=0,C[3]=0,C[4]=0, %) ; 

3xi(t)^i(t) + (2 + 2x 2 (t)) Mt) + x 3 (t)Mt) + 3x 4 (t)Mt) ~ 2 (Vo ((«iW) 2 + M*)) 2 ) 
+ (1 + x 2 (t)) + ^ 2 (i)«i(i)x 3 (i) + ^ 3 (i)n 2 (t) + Mt)Mt) (x 3 (t)) 2 y = const 

we have the conservation law obtained in \21\ Example 5.3]. 
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Example 13 (0 , 04") Let us consider 

b 

J u{t) 2 c\t — > min, 

a 

f x(t) = l + y(t) 2 1 

1 m = u(t). 

> L:=u~2; phi : = [l+y~2 ,u] ; 

L := u 2 

cp ■= [l+y 2 ,u] 

> Symmetry (L, phi, t, [x,y] , u) ; 

jr = ~ dt + c 2 , x 1 = -i cit + c x x + c 3 , x 2 = - A c iy , 
u = -~Ciu, *i = * 2 = - J CivJ 

> Noether(L, phi, t, [x,y] , u, °/ ) ; 

( - ~ Cit + dx(t) + C 3 ) + \ Cw(t)Mt) 

- (Vo («(*))* + ^i(t) (l + (y{t)) 2 ) + MtM*)) (I C lt + C 2 ^j = const 

From substitutions 

> subs (C [1] =-4 , C [2] =0 , C [3] =0 , %) ; 

(2t - 4s(t)) - y(t)Mt) + 2 (Vo (u(t)) 2 + Mt) (l + (?/(*)) 2 ) + ^(*M*)) t = const 
we obtain the conservation law in \21\ Example 6.2]. 

Example 14 (2 '44") We consider now a minimum time problem (T — ► min J Q T ldt - 
min ) with the following control system: 

X\{t) = 1 + x 2 (t), 

x 2 {t) = x 3 (t), 

x 3 (t) = u(t), 

x 4 {t) = x 3 {t) 2 -x 2 {t) 2 . 

In Maple we have: 
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> L:=l; phi: = [l+x[2] ,x[3] ,u,x [3] ~2-x [2] ~2] ; 



L := 1 

ip ■= [1 + x 2 ,x 3 ,u,x 3 2 - x 2 2 ] 
> Symmetry (L , phi, t, [x [1] ,x [2] ,x [3] ,x [4] ] , u) ; 



T = C 5 , X x = (~ C 2 - X - c\ t + X - C 2Xl + C 4 , X 2 = -± Ci + I C 2 x 2 , 
x z = \ °2 X 3, X A = -dt + C x x x + C 2 x 4 + C 3 , 

U=- UC 2 , #1 = -- C 2 ^x - Cl^4, ^2 = C 2^2, #3 = - j CsV'S, *4 = -C 2 ^4 

> Noether(L, phi, t, [x [1] ,x [2] ,x [3] ,x [4] ] , u, %) ; 



™ C 2 - ~ i + i C aa?1 (t) + C 4 ) Mt) + Ci + \ C 2 x 2 {t)^ fa(t) 

+ 2 CfeajaC*)^*) + + C'^iW + ^(t) + C 3 ) ^ 4 (t) 

+ (1 + x 2 (t)) Mt) + x 3 (t)^ 2 {t) + ^s(*)«(t) + ((x 3 (*)) 2 - (x 2 (t)) 2 ) ^4(t)) C 5 = const 

With the appropriate values for the constants, 

> subs (C [1] =0 , C [2] =2 , C [3] =0 , C [4] =0 , C [5] =0 , °/„) ; 

(-i + xiO))Vi(t) +x 2 (t)?p 2 (t) + x 3 (t)ijj 3 (t) +2z 4 (t)^ 4 (t) = consi 
we obtain the conservation law derived in \27[ Example 6.3]. 

Example 15 (0'25") Follows another problem of minimum time, with control system given 
by 

x(t) = 1 + y(t) 2 - z(t) 2 , 
y(t) = z(t) , 
z{t) = u(t) . 

> L:=l; phi:=[l+y~2-z~2,z,u] ; 

L := 1 

V : = t 1 +?/ 2 - z 2 ,z,u] 

> Symmetry (L, phi, t, [x,y,z] , u) ; 
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T = C 2 , X 1 = -dt + Cix + C 3 , X 2 = ^ Ciy, X 3 = X - C lZ , 



> Noether(L, phi, t, [x,y,z] , u, %) ; 

(-dt + dx{t) + C 3 ) ^i(t) + \ dy(t)Mt) + \ c\z(t)Mt) 

- (Vo + Mt) (l + (y(i)) 2 " (z(t)f) + ^2(t)«(t) + C 2 = const 

Substitutions 

> subs(C[l]=2,C[2]=0,C[3]=0, °/„) ; 

(-2t + 2x(t))^i(t) + y(t)ip 2 (t) + z(t)ifo(t) = const 
specify the conservation law in the one obtained in \2% Example 6.4J- 



We finish the section by applying our Maple package to three important problems of 
geodesies in sub-Riemannian geometry. The reader, interested in the study of symmetries 
of flat distributions of sub-Riemannian geometry, is referred to [TH] . 

Example 16 (Martinet — (2,2,3) problem) Given the problem (n = 3,m = 2) 



mm, 



(iti(t) 2 + u 2 (tf) dt 

Xi(t) = Ui(t), 

1 + axi(t) 
^ x 3 (t) = x^tfu^t), 

we consider two distinct situations: a = (Martinet problem of sub-Riemannian geometry 
in the flat case - see [2]) and a^O (non-flat case). 

Flat Problem (a = 0, 1'06"): 

> L:=u[l]~2+u[2]~2; phi : = [u [1] ,u[2] ,x [2] ~2*u [1] ] ; 

L := ui 2 + u 2 2 
(p := [ui,u 2 ,x 2 2 ui] 

> SymmetryCL, phi, t, [x [1] ,x [2] ,x [3] ] , [u [1] ,u [2] ] ) ; 
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T = | dt + C 2 , x ± = \ Cixx + C 4 , X 2 = i Cix 2 , X 3 = C x x 3 + C 3 , 
Ui = --uxC h U 2 = -- Cm 2 , *i = -- dip!, ^2 = - g Ci^ 2 , #3 = -Ci^3 
> Noether(L, phi, t, [x [1] ,x [2] ,x [3] ] , [u[l],u[2]], '/.) ; 



i Cixi(t) + cA Mt) + ~ c x x 2 {t)^ 2 {t) + (Cix 3 (t) + c 3 ) Mt) 

V' ((ni(t))V(n 2 (t)) 2 )+V'i(t)uiW+V'2(t)n2(t)+V'3(t)(^2W) 2 «i(t)) \^C\L + ( ) rO,,.s/ 

£/ie substitutions 
> subs(C[l]=3,C[2]=0,C[3]=0,C[4]=0, 7„) ; 

xi (t) + x 2 (t)V> 2 (t) + 3 x 3 (i)Va (*) 

- 2 f^ (W^)) 2 + M^)) 2 ) + ^(t)Mi(t) + Mt)Mt) + MO) 2 )* = consi 



we ge£ i/ie conservation law first obtained in \2h} Example 2]. 

Non-Flat Problem (a ^ 0, 1'14"): 
> L:=u[l] ~2+u[2] "2; phi: = [u[l] ,u [2] / (l+alpha*x [1] ) ,x[2] ~2*u[l]] ; 



L := u\ + u 2 



U 2 2 
U!,— ,X 2 U! 

1 + ax! 



(p :-- 

> simplify (Symmetry (L , phi, t, [x [1] ,x [2] ,x [3] ] , [u[l] ,u[2]] )) ; 



{T = 2C 7 t + Cii, X X = C 7 {a- 1 + xx), X 2 = 0, X 3 = C 7 x 3 + C w , 
U x = -C 7 ux, U 2 = -C 7 u 2 , $i = -C 7 ipx, ^2 = 0, # 3 = -C 7 ip 3 } 

> Noether(L, phi, t, [x [1] ,x [2] ,x [3] ] , [u[l],u[2]], °/„) ; 

^(a" 1 + xx(t))Mt) + (C 7 x 3 (t) + C10) 

WTien C 7 = 1 and C w = Cn = 0, 

> subs(C[7]=l,C[10]=0,C[ll]=0, °/„); 
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- 2 U Q ((Mt)) 2 + (Mt)) 2 ) + U!(t)Mt) + r, (t) ^ ( ^ + (X2(t)) 2 ux(t)Mt)) t = const 
\ \ J l + axi(t) J 

we obtain the conservation law proved in 12,% Example 2]. 

Example 17 (Heisenberg — (2,3) problem) (1'04") The Heisenberg (2,3) problem can 
be formulated as follows: 



b 



1 



mm, 



( Ul (ty + u 2 (ty) dt- 

Xi{t) = Ui(t) , 

x 2 (t) = u 2 (t) , 
% 3 {t) = u 2 {t)x x {t) . 

The problem was proved to be completely integrable using three independent conservation 
laws Such conservation laws can now be easily obtained with our Maple functions. 

> L:=l/2*(u[l] ~2+u[2] ~2) ; 

> phi: = [u[l] , u[2], u[2]*x[l]]; 



L := - Ul +-u 2 
ip := [ui,u 2 ,u 2 xi] 

> Symmetry(L, phi, t, [x [1] ,x [2] ,x [3] ] , [u [1] ,u [2] ] ) ; 

{T = 2C 2 t + C 5 , X l = C 1 + C 2Xl , X 2 = C 2 x 2 + C 3 , X 3 = C x x 2 + 2 C 2 x 3 + C 4 , 

U x = -C 2 u u U 2 = -C 2 u 2 , #i = -C 2 ip l7 ^ 2 = -C 2 ip 2 - foCx, * 3 = ~2C 2 ip 3 } 

> CL:=Noether(L, phi, t, [x[l] ,x[2] ,x[3]] , [u[l],u[2]], %) ; 

CL := (Cx + C 2 xx(t)) Mt) + (C 2 x 2 (t) + C 3 ) Mt) + {C x x 2 (t) + 2 C 2 x 3 (t) + C 4 ) Mt) 
V>o Q {ux{t)) 2 + \ (Mt)) 2 ^j+Mt)ux (t)+Mt)Mt)+Mt) u 2{t)xx {t) \ (2C 2 t + C 5 ) = const 

We now want to eliminate the controls from the previous family of conservation laws. We 
begin to define the Hamiltonian: 

> H:=-L+Vector [row] ( [psi [1] (t) , psi[2](t), psi [3] (t)] ) .Vector (phi) ; 

H := "I 2 ~ \ u2 + u iMt) + u 2 Mt) + u 2 xxMt) 
The stationary condition permits to obtain the pair of controls (ux(t) , u 2 (t)) . 
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> solve({diff (H,u[l])=0, diff (H,u[2])=0>, {u[l],u[2]»: 

> subs(x[l]=x[l] (t) , u[l]=u[l] (t), u[2]=u[2] (t), 50; 

It is not difficult to show that the problem does not admit abnormal extremals, so one can 
choose, without any loss of generality, ipQ = — 1. 

> CL:=subs(psi[0]=-l, %, CL) ; 

CL := (d + C 2 xi(t)) Mt) + (C 2 x 2 (t) + C 3 ) tfatt) + (Ci*2 (*) + 2 C 2 x 3 (t) + C 4 ) V 3 (i) 

- Q {Mt)f-\ {Mt) + xi{t)^{t)) 2 + ^2{t){Mt) + *i (t)Mt)) 

+ ^3 (t) (Mt) + xi (t) if) 3 (t)) x i (*)J ( 2 Cat + C 5 ) = consi 

It is easy to extract from the family of conservation laws just obtained, three independent 
conservation laws. We just need to fix one constant to a non-zero value, and choose all the 
other constants to be zero: 

> subs(C[4]=l,seq(C[i]=0,i=l. .5) , CL) ; 

> subs(C[l]=l,seq(C[i]=0,i=l. .5) , CL) ; 

> simplify (subs (C [5] =-l,seq(C[i]=0,i=l. .5) , CL)); 

ip3(t) = const 

x 2 (t)ip 3 (t) +ipi(t) = const 

2 ^i(*) 2 + 2 ^ 2(t)2 + Mt)Mt)Mt) + g Mt) 2 Mt) 2 = const 

The last conservation law corresponds to the Hamiltonian. This, and ifj 3 = const, are 
trivial conservation laws for the problem. The missing first integral to solve the problem, 
^2^3 + i>\, was obtained in IHf . 

Example 18 (Cartan — (2,3,5) problem) (30'34") The Cartan problem with growth 
vector (2, 3, 5) can be posed in the following way: 

b 

i J (ui{tf + u 2 (tf) dt — ► min, 
o 

±i(t) = Mi(t) , 
X 2 (t) = U 2 (t) , 
< x 3 (t) = U 2 (t)Xi(t) , 
X A (t) = \ U 2 (t)Xi(tf , 

k x 5 (t) = u 2 (t)xi(t)x 2 (t) . 

The integrability of the problem was recently established in This is possible with five 

independent conservation laws. They can easily be determined with our Maple package. 
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> L:=l/2*(u[l]~2+u[2]~2); 

> phi: = [u[l], u[2], u[2]*x[l], l/2*u [2] *x [1] "2 , u [2] *x [1] *x [2] ] ; 



1 2 1 2 

:= 2 M1 + 2 U2 



f := [ui,U2,U 2 Xi^U 2 Xi 2 ,U2XlX2] 



> Symmetry (L , phi, t, [x [1] ,x [2] ,x [3] ,x [4] ,x [5] ] , [u [1] ,u [2] ] ) ; 



Y=l Ci* + C 4, X 1 = 1 Cixi, X 2 = 1 Cix 2 + C 2j X 3 = | Cix 3 + C 6 , 

X 4 = C lXA + C 5 , X 5 = C 2 x 3 + Cix 5 + C 3 , E/i = -- Ci«i, C/ 2 = -3 Ciu 2 , 
112 

*1 = -3 CiV'l, ^2 = -g^Ci, ^3 = --Ci^ 3 -C 2 ^ 5 , *4 = -Cl^4, *5 = -Cl^ 5 
> CL:=Noether(L, phi, t, [x[l] ,x[2] ,x[3] ,x[4] ,x[5]] , [u[l],u[2]], %) ; 



C7L := i C i;El (i)Vi(t)+Q Cix 2 (t) + C2J V> 2 (*)+(~ C x x&) + C 6 J V 3 (t)+(C 1 x 4 (t) + C 5 ) ^ 4 (t) 
+ (C 2 x 3 (t) + Cix 5 (t) + C 3 ) ^s(t) - Uo Q (^iW) 2 + ^ M^)) 2 ) + + u 2 (t) Mt) 

+ u 2 (t)xi(i)^3(i) + \u 2 (t) (xi(t)) 2 Mt) + U2(t) Xl (t)x 2 (t)ip 5 (t)J Q Cit + C7 4 ^) = cons* 
T/ie Hamiltonian is given by 

> H:=-L+Vector [row] ([psi[l] (t) , psi[2](t), psi[3](t), psi[4](t), 

psi [5] (t)] ) .Vector (phi) ; 

H := -- til 2 - - U 2 + U\^)\ it) + U 2 1p 2 (t) + -U 2 XiV> 3 (t) + - U2X 1 2 lfj 4 (t) + U 2 XlX2^5(t) 

and the extremal controls are obtained through the stationary condition (J7J). 

> solve({diff (H,u[l] )=0, diff (H,u[2] )=0>, {u[l],u[2]»: 

> subs(x[l]=x[l](t),x[2]=x[2](t), u[l]=u[l](t),u[2]=u[2](t), %) ; 

Ul (t) = V>1 (t) , U 2 (t) = Xi (t) X 2 (t) fa (t) + i) 2 (t) + Xi (t) ^3 (*) + 7^1 (t) 2 ^4 (t) 

> CL:=subs(psi[0]=-l, %, CL) ; 
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CL := 1 C lXl (t)Mt) + Q C\x 2 (t) + C 2 ^ Mt) + Q C x x3(t) + C 6 J ^(i) 

+ (Cix 4 (0 + C 5 ) V>4(t) + (C 2 x 3 (t) + Cix 5 (*) + C 3 ) Vs(t)- ^i(i) 2 

1 / 1 x 2 

- - f xi(*)x 2 (t)^5 (*) + V> 2 (i) + x x {t)i>z(t) + - 2;i(t) 2 V4(t) 

+ (i) x 2 (t)^ 5 (i) + ^ 2 (t) + ari(t)^3 (*) + ^ xi(t) 2 ^ 4 (t)) ^ 2 (t) 
+ (xi(t)x 2 (t)i> 5 (t) + ^j(t) + x x {t)^{t) + ^ xi(t) 2 V 4 (t)) xi(t)^(t) 
+ X - U(t)x 2 (t)^ 5 (i) + ^2 (t) + xi(t)^s(t) + ^ (xi(t)) 2 ^ 4 (*)) xi(t) 2 V 4 (t) 



-I- ! x l {t)x 2 {t)ij; b {t) + ^2 (t) + xi(*)^3(*) + £ ^i(0 2 ^4 (t) S -''I )' ■.-,(/ ) 



The five conservation laws we are looking for, are easily obtained (the last one corresponds 
to the Hamiltonian) : 



> subs(C[6]=l,seq(C[i]=0,i=l. .6) , CL) 

> subs(C[5]=l,seq(C[i]=0,i=l. .6) , CL) 

> subs(C[3]=l,seq(C[i]=0,i=l. .6) , CL) 

> subs(C[2]=l,seq(C[i]=0,i=l. .6) , CL) 

> simplify (subs (C [4] =-l,seq(C[i]=0,i=l. .6) , CL)); 



tps(t) = const 
■04 (t) = const 
■05 (t) = const 
i*2 (t) + ■05(^)^3(0 = const 

- X l {t) 2 X 2 (t) 2 ^ 5 {t) 2 + Xl {t)x 2 (t)^ 5 (t)^ 2 {t) + X^tfx^t)^)^) + - Xl(t) 3 X 2 (t)^ 5 (t)V'4(t) 
+ - Xl (t) 2 ^ 3 {t) 2 + - Xl (tf^(tf + - ^l(t) 2 + Mt)xi(t)Mt) + \i>2 (t) Xl(t) 2 ^4(0 

+^xi(t) 3 V'3(i)^4(t) + ^(i) 2 = cons* 

One can say that for the Cartan (2,3,5) problem we have four trivial first integrals: the 
Hamiltonian H; and the multipliers -03, ip^, ip^. Together with the non-trivial integral 
^3^5 + ^2, the problem becomes completely integrable (see fT^). 



19 



Automatic Computation of Conservation Laws in Optimal Control 



5 Conservation Laws in the Calculus of Variations 

Let us consider the classical problem of the calculus of variations with higher-order deriva- 
tives: to minimize an integral functional 



J[x(-)] = / L(t,x(t),x(t), 



Ar) 



(t)) dt 



subject to certain boundary conditions, and where the Lagrangian L depends on the inde- 
pendent variable t G K, on n dependent variables x(£) = [xi[t), X2\t), ■ ■ ■ , x n (t)\ G M™, 
and its r first derivatives (x(t) = x^^(t)): 



(t) 



d^it) d i x 2 {t) d*a; ft (t) 
dt* ' dt* ' ' " ' dt 4 



It is well known that the problems of the calculus of variations are a particular case of 
the optimal control problem (|T|l-(|2^1. The standard technique to write the problem of 
minimizing (jl8)l as an optimal control problem consists to introduce new functions 



x, x 1 = x, x 2 



.(2) 



,r-l 



c*- r l \ and u 



With this notation at hand, the equivalent optimal control problem has rn state variables 
1, . . . , n, j = 0, . . . , r — 1), and n controls (u = x^): 



(so * 



J[x(-),u(-)] = / L(t,x(t),u(t))dt — ^min. 



x 2 (t) 



fx°(t) 

xHt) 



x- 2 (t) 



U(t) 



Since any problem of the calculus of variations can always be rewritten as an optimal 
control problem, we can also apply our Maple package to obtain variational symmetries and 
conservation laws in the classical context of the calculus of variations, and thus recovering 
the previous investigations of the authors [7 j . We recall that for the problems of the calculus 
of variations there are no abnormal extremals (one can always choose i/jq = —1). Follow 
some examples. 

Example 19 (0'08") We begin with a very simple problem of the calculus of variations, 
where the Lagrangian depends only on one dependent variable (n = 1), and where there are 
no derivatives of higher order than the first one (r = 1): L(t,x,x) = tx 2 . According with 
the above mentioned technique of rewriting the problem as an optimal control problem, we 
write the following definitions in Maple: 
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> L:=t*v~2; u:=v; phi:=u; 



L 


:= tv 2 


u 


:= v 




:= v 



Our procedure Symmetry determine the general infinitesimal generators which define the 
family of symmetries for the problem of the calculus of variations under consideration: 

> Symmetry (L , phi , t , x , u) ; 

{T = tCi, X = C 2 ,U = -vCi, * = 0} 

The conservation laws corresponding to the computed symmetries, are obtained with the 
procedure Noether.- 

> Noether (L, phi ,t ,x,u,%) ; 

C 2 ip(t) - {^ot (v(t)) 2 + tp(t)v(t)j tCi = const 
Going back to the original notation (v = x), we can write: 

> CL:=subs(psi[0]=-l,v(t)=diff (x(t) ,t) ,%) ; 

d , S 1 <l 



CL := C 2 ip{t) + \ t {-^xi^J ~ ^fa^J tCl = consL 

In this case one can easily use the definition of first integral (a function that is preserved 
along the extremals of the problem), to verify the validity of the obtained expression. For 
that we compute the pair (x(t), ip(t)) that satisfies the adjoint system and the maximality 
condition J3|) of the Pontryagin maximum principle (Theorem^. 

> H:=-L+psi(t)*phi; 

H := -tv 2 +^{t)v 

> {diff (H,u)=0, diff (psi(t) ,t)=-diff (H,x)>; 

— ip(t) = 0,-2tv + tp(t) = 

After substituting v = x, we obtain the extremals by solving the above system of differential 
equations: 



> subs(v=diff (x(t) ,t) ,°/,) 



> dsolve (%) ; 



j^(t) =Q,-2tj t x(t) + ^(t) = 
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il>(t) = K B ,x(t) = ±K g hi(t) + K 1 

Expression for x(t) coincides with the Euler- Lagrange extremal Example 5.1]). Substi- 
tuting the extremals in the conservation law one obtains, as expected, a true proposition: 



> expand ( subs (%, CL) ) ; 



C 2 K% — — C1K2 2 = const 



Substituting only ip(t), one can get the family of conservation laws in the notation of the 
calculus of variations: 

> expand(subs(psi(t)=K[2] ,CL)) ; 

(d \ 2 d 
— x(t) j - tCiK 2 -jj. x (t) = const 

> subs(C[2]*K[2]=0,C[l]=-l, /,) ; 

-t 2 ( ^-x(t)] + tK 2 ^-x(t) = const 
\dt J dt 

Example 20 (Kepler's problem) (0'17") We now obtain the conservation laws for Ke- 
pler's problem - see p. 217]. In this case the Lagrangian depends on two dependent 
variables (n = 2), without derivatives of higher- order (r = 1): 

L(t, q, q) = ? (<?i + ?f) + ^ 



The family of conservation laws for the problem is easily obtained with our Maple package: 

> L:= m/2*(v[l]-2+v[2]-2)+K/sqrt(q[l]-2+q[2]-2) ; x : = [q [1] , q [2] ] ; u : = [v [1] , v [2] ] ; 
phi: = [v[l] ,v[2]] ; 

L := \ m (V + v 2 2 ) + 



2 Vqi 2 + Q2 2 

x := [q\,q2\ 
u := [vi,v 2 ] 
cp := [vi,v 2 ] 

> Symmetry (L, phi, t, x, u) ; 

J (Ci - c 2 ) y>2 TT n (Ci - c 2 )^\ 

\ T = C 3 , Xi = -Ciq 2 , X 2 = Ciqi, U\ = -C 2 v 2 H ■ , U 2 = C 2 v\ ; . 

*1 = -Cl^ 2 , ^2 = Clip! } 
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> Noether(L, phi, t, x, u, %) : 

> CL:=subs(psi[0]=-l,%) ; 

cl -.= -c iq2 (t)Mt) + c iqi (t)Mt) 

-l~m { Vl (t) 2 + v 2 (t) 2 ) - f — + MVMt) + Mt)v 2 (t) ) C 3 = const 

To obtain the conservation laws in the format of the calculus of variations, one needs to 
compute the Pontryagin multipliers (ipi(t), fait)), 

> H:=-L+Vector [row] ( [psi [1] (t) , psi [2] (t)] ) . Vector(phi) ; 

1 K 
H := --m(vi 2 + v 2 2 ) . + vi^i(t) + v 2 i/j 2 (t) 

1 V ?i + Q2 2 

> solve({diff (H,v[l])=0,diff (H,v[2] )=0},{psi [1] (t) , psi [2] (t)}); 

{i>i{t) = mvi,ip 2 (t) = mv 2 } 
and substitute the expressions, together with t>i(i) = Qx{t) and v 2 {t) = q 2 (t): 

> expand(subs(°/,,v[l] (t)=v[l] ,v[2] (t)=v[2] ,v[l]=diff (q[l] (t) ,t) , 

v[2]=diff (q[2] (t),t),CL)); 

d , , „ , , d _ 1 ( d , \ 2 1 ( d 



-C iq2 (t)m- qi (t) + C iqi (t)m- q2 (t) - - C 3 m I - qi {t) j - - C 3 m I -q 2 (t) 

C 3 K 

H ; = const 

Vn(t) 2 + Q2(t) 2 

This is the conservation law in 17, Example 5.2]. 

Example 21 (6'42") Let us see an example of the calculus of variations whose Lagrangian 
depends on two functions (n = 2) and higher-order derivatives (r = 2): 

L(t, x, x, x) — X-^ ~\~ C&2 • 

We write the problem in the optimal control terminology, and make use of our Maple 
procedure Symmetry to compute the symmetries: 

> L:=v[l]~2+a[2]~2; xx: = [x[l] ,x[2] ,v[l] ,v[2]] ; u: = [a [1] , a [2] ] ; 
phi: = [v[l] ,v[2] ,a[l] ,a[2]] ; 



L 

xx 
u 



vi 2 + a 2 2 
[x 1 ,x 2 ,v 1 ,v 2 ] 
[ai,a 2 ] 
[v 1 ,v 2 ,a 1 ,a 2 ] 
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> Symmetry (L, phi, t, xx, u) ; 



T = 2 C 3 t + C 4 , X l = C 3Xl + C 5 , X 2 = td + 3 C 3 x 2 + C 6 , X 3 = -C 3 vi, X A = d + C 3 v 2 
Ui = -3C 3 ai -2ip C 2 a 2 - C 2 Tp A , U 2 = -C 3 a 2 + C 2 ip 3 , 

*1 = -CsV'l, *2 = -3C 3 ^2, #3 = C 3 1p 3 , f 4 = -C 3 ^ 4 



We choose, in the conservation law returned by our Maple procedure Noether, ifio = — 1, 
and then go back to the calculus of variations notation: V\(t) = Xi(t), v 2 (t) = x 2 (t), 
ai(i) = xi(t), and a 2 (t) = x 2 (t): 

> Noether(L, phi, t, xx, u, %) : 

> CL:=subs(psi[0]=-l, v [1] (t)=dif f (x [1] (t) ,t) , v[2] (t)=diff (x[2] (t) ,t) , 
a[l] (t)=diff (x[l] (t) ,t$2) , a [2] (t)=dif f (x [2] (t) ,t$2) ,'/,) ; 

CL := (C 3Xl (t) + C 5 ) Mt) + (tCt + 3C 3 x 2 (t) + C 6 ) Mt) - c 3 (i*i(t)\ Mt) 

+ (c 1 + c 3 ±Mt)) M t) - (- (j t Mt)) 2 - (^)) 2 + Mt)j^(t) 

d d 2 d 2 \ 

+ ifo{t)—x 2 (t) +Mt) ^2^1 (*) + Mt)jpX2(t) J (2C 3 t + C 4 ) = const 

Similarly to Example Mfy we can also compute through Maple the extremals and verify, by 
definition, the validity of the obtained family of conservation laws. 

> vpsi:=Vector[row] ( [psi[l] (t) , psi[2](t), psi[3](t), psi[4](t)]): 

> H:=-L+vpsi .Vector (phi) ; 

H := -v 2 - a 2 2 + Viipi(t) + v 2 ^ 2 (t) + ai%fj 3 (t) + a 2 ^4(t) 

> {diff (H,u[l] )=0, diff (H,u[2] )=0, dif f (vpsi [1] ,t)=-dif f (H,xx [1] ) , 

diff (vpsi [2] ,t)=-diff (H,xx[2]) , diff (vpsi [3] ,t)=-diff (H,xx[3] ) , 
diff (vpsi [4] , t ) =-dif f (H , xx [4] ) > : 

> subs(v[l]=diff (x[l] (t) ,t) , a[2]=diff (x[2] (t) ,t$2) , %) ; 

j t i> 3 {t) = 2 j tXl {t) - Mt), j t Mt) = o, j t Mt) = -Mt),Mt) = o, j t Mt) = o, 

d 2 

-2-^x 2 {t) + Mt) = 

Solving the above system of equations, that result from the maximality condition and adjoint 
system, 

> dsolve(%) ; 
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jxi(i) = -K 6 t + K 4 , x 2 (t) = -^K 5 t 3 + ^K 3 t 2 + K 1 t + K 2 ,i; 3 (t) = 0, 

Mt) = K 6 , Mt) = ~K 5 t + K 3 , Mt) = K 5 ] 

we obtain the extremals (the extremal state trajectories Xi(t) and x 2 {t) are the same as 
the ones obtained in [1, Example 5.3], by solving the Euler-Lagrange necessary optimality 
condition) that, substituted in the conservation law, 

> expand ( subs (%, CL) ) ; 

1 



K 6 C 3 K 4 +K 6 C 5 + 3K 5 C 3 K 2 + K 5 C 6 + C X K 3 + C 3 K t K 3 - - K 6 Z C 4 



,\i\ 3 t <^ 3 ^1 n-3 — J ^6 2 

^K 3 2 C A -K 5 Ki C 4 = const 



conduces to a true proposition (constant equal constant). Finally, substituting only the 
Pontryagin multipliers, 

> subs ({psi [1] (t)=K[6] , psi[3](t)=0, psi [4] (t)=-K [5] *t+K [3] , psi [2] (t)=K [5] } , CL) ; 

(C 3 xi(t) + C B ) K 6 + (dt + 3C 3 x 2 (t) + C 6 ) K 5 + (Ci + C 3 ^x 2 (t)\ (-K 5 t + K s ) 

d 2 \ 

+ {-K 5 t + K 3 )-^x 2 {t) \ (2C 3 t + C 4 ) = const 

the conservation law takes the form of a differential equation of less order than the one 
obtained in J7| Example 5.3] (the Hamiltonian approach is here more suitable than the 
Lagrangian one). 

Example 22 (Emden- Fowler) (O'Ol") Given the variational problem of Emden-Fowler 
|3 p. 220], defined by the Lagrangian 



L := - t v — - x 



> L:= t~2/2*(v~2-x~6/3) ; 



2 V 3 

we are interested to find, following our methodology, the conservation laws for the problem. 

> Symmetry (L , v, t, x, v) ; 

{T = -2tCt, X = dx, U = 3C lV , * = -V>Ci} 

> Noether (L , v , t , x , v , %) : 

> CL:=subs(psi [0] =-!,%) ; 
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CL := C lX (t)^(t) + 2 (~ t 2 (v(t) 2 - | x(tf^j + ip(t)v(t)\ tC x = const 

The expression for the tjj(t) comes from the stationary condition. 

> H:=-L+psi(t)*v; 

> solve (dif f (H,v)=0,{psi(t)» ; 

{m = t 2 v} 

> subs(°/o,v(t)=diff (x(t) ,t) ,v=diff (x(t) ,t) ,CL) : expand (°/ ) ; 

d ( d \ 2 1 

Cix(t)t 2 — x(t) + t 3 Ci ( -rx(t) ) + - t 3 dx(tf = const 

Civ \ CtC / o 

Fixing C\ = 3, 

> subs (C[l] =3,7,) ; 



3x(t)t 2 —x(t) +3r (^^WJ +t d x(t) b = const 

we obtain the same conservation law as the one obtained in V\ Example 5.4], with the 
methods of the calculus of variations. 

Example 23 (Thomas-Fermi) (O'Ol") We consider the problem of Thomas-Fermi 
p. 220], showing an example of a problem of the calculus of variations which does not admit 
variational symmetries. 

> L:=l/2*v~2+2/5*x~(5/2)/sqrt(t) ; 

1 2 2 art 
L := -v -\ = 

2 5 

> Symmetry (L, v, t, x, v) ; 

{T = 0, X = 0, U = 0, * = 0} 

Our Maple function Symmetry returns, in this case, vanishing generators. As explained 
in $3 this means that the problem does not admit symmetries. 

Example 24 (Damped Harmonic Oscillator) (0'02") We consider a harmonic oscil- 
lator with restoring force —kx, emersed in a liquid in such a way that the motion of the 
mass m is damped by a force proportional to its velocity. Using Newton's second law one 
obtains, as the equation of motion, the Euler-Lagrange differential equation associated with 
the following Lagrangian fTi\ pp. 432-434]-' 

> L:=l/2*(m*v~2-k*x~2)*exp((a/m)*t) ; 
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X * (\ r\\ at 

L := — [mv — kx J e m 

In order to find the conservation laws, we first obtain, as usual, the generators which define 
the symmetries of the problem. 

> simplify (Symmetry (L,v,t ,x,v) ) ; 

2md 



, X = dx, U = dv, ¥ = -ipC 



> Noether(L,v,t,x,v,°/ ) : 

> CL:=subs(psi[0] =-!,%) ; 



CL := C 1 x(t)t/>(t)+2(~ (mv(t) 2 - kx(t) 2 ) e- +ip(t)v(t) \ mCia" 1 



const 



The value for ijj(t) is easily determined, and we can write the obtained family of conserva- 
tion laws in the language of the calculus of variations. 

> H:=-L+psi(t)*v; 

1 j r\ at . . 

H := — — [mv — kx J e™ + ip(t)v 

> solve (diff (H,v)=0,{psi(t)}) ; 

^(t) = mve-m | 

> simplify(subs(°/„,v(t)=diff (x(t) ,t) ,v=diff (x(t) ,t) ,CL)) ; 

C\me~ ^x(t) a + m ^^ x (^)^ + kx(t) 2 ^j a -1 = const 

Choosing an appropriate value to the constant C\ 



> subs(C[l]=-a/(2*m) ,%) ; 



-e™ (x(t)(^x(t)ja + m(—x(t)j + kx(t) 2 j = const 



we obtain the conservation law in 11 11 Ch. 7, Example 1.10]. 
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6 The Maple package 

The procedures Symmetry and Noether, described in the previous sections, have been 
implemented for the computer algebra system Maple (version 9.5). 

Symmetry computes the infinitesimal generators which define the symmetries of the op- 
timal control problem specified in the input. As explained in sections El and El this 
procedure involves the solution of a system of partial differential equations. We have 
used the Maple solver pdsolve, trying to separate the variables by sum. 

Output: 

- set of infinitesimal generators. 

Syntax: 

- Symmetry(L, tp, t, x, u, [all]) 

Input : 

L - expression of the Lagrangian; 

tp - expression or list of expressions of the velocity vector cp which defines the control 
system; 

t - name of the independent variable; 

x - name or list of names of the state variables; 

u - name or list of names of the control variables; 

all - This is an optional parameter. When all is given in the last argument of the 
procedure Symmetry, the output presents all the constants given by the Maple 
command pdsolve. By default, that is, without optional all, we eliminate re- 
dundant constants. This is done by our Maple procedure reduzConst. This is a 
technical routine, and thus not provided here. Essentially, the procedure trans- 
forms in one constant each sum of constants not repeated in the conservation 
law. The interested reader can find the Maple file with its definition, together 
with the Symmetry and Noether code, that constitute our Maple package, at 
http:/ /www. mat. ua.pt/delfim/maple. htm. 

Symmetry : =proc (L : : algebraic , phi : : {algebraic , list (algebraic) } , t : : name , 

xO : : {name , list (name) } , uO : : {name , list (name) }) 
local n,m, xx, i, vX, vPSI, vU, vv, lpsi, H, eqd, syseqd, sol, conjGerad, lphi; 
unprotect (Psi) ; unassign( 'T' ) ; unassign( 'X' ) ; unassign( 'U' ) ; unassign( 'Psi ' ) ; 
unassign( 'psi ' ) ; 
n:=nops(xO); m:=nops(uO); 

if n>l then lphi : =phi ; lpsi := [seq(psi [i] , i=l . .n)] ; 
else lphi : = [phi]; lpsi : = [psi]; fi; 
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xx : =op(xO) , op(uO) , op(lpsi) ; vv: =Vector ( [seq(v | | i , i=l . . 2*n+m)] ) ; 
if n>l then vX:=Vector( [seq(X[i] (t,xx) , i=l..n)]); 
else vX:=Vector( [X(t,xx)] ) ; fi; 

if n>l then vPSI : =Vector ( [seq(PSI [i] (t ,xx) , i=l . .n)] ) ; 

else vPSI:=Vector([PSI(t,xx)]) ; fi; 

if m>l then vU:=Vector( [seq(U[i] (t,xx) , i=l..m)]); 

else vU:=Vector( [U(t,xx)] ) ; fi; 

H:=psi [0] *L+Vector [row] (lphi) .Vector (lpsi) ; 

eqd:=diff (H,t) *T(t ,xx) +Vector[row] ( [seq(dif f (H, i) ,i=x0)]) .vX+Vector [row] ([seq( 
diff (H,i) ,i=u0)]) .vU+Vector [row] ( [seq(dif f (H,xx[i] ) ,i=n+m+l. .n+m+n)]) .vPSI 
-LinearAlgebra [Transpose] (vPSI) .vv[l. .n] -Vector [row] (lpsi) . (map(dif f ,vX,t) 
+Matrix( [seq (map (diff ,vX,i) ,i=xx)] ) .vv)+H*(diff (T(t,xx) ,t) 
+Vector [row] ( [seq (diff (T(t ,xx) , i) , i=xx)] ) . vv) ; 
eqd:=expand(eqd) ; eqd:=collect(eqd, convert (vv, ' list ') , distributed); 
syseqd:={coeff s(eqd, convert (vv, 'list'))}: 

conjGerad:={T(t,xx)}union convert (vX, ' set ' ) union convert (vU, ' set ' ) 

union convert (vPSI ,' set ') ; 

sol:=pdsolve(syseqd, conjGerad, HINT= < + < ); 

sol : =subs (map(i->i=op(0 , i) , conjGerad) ,sol) ; sol:=subs(PSI='Psi' ,sol) ; 
if nargs<6 or args [6] <> ' all ' then sol : =reduzConst (sol) ; fi; 
return sol; 
end proc : 

Noether given the infinitesimal generators which define a symmetry, computes the con- 
servation law for the optimal control problem, according with Theorem [7| (Noether's 
theorem). 

Output: 

- conservation law. 

Syntax: 

- Noether(L, (p, t, x, u, S) 

Input: 

L - expression of the Lagrangian; 

ip - expression or list of expressions of the velocity vector cp which defines the control 
system; 

t - name of the independent variable; 

x - name or list of names of the state variables; 

u - name or list of names of the control variables; 

S - set of infinitesimal generators (output of procedure Symmetry) . 
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Noether : =proc (L :: algebraic , phi :: {algebraic , list (algebraic)}, t::name, 

xO : : {name , list (name) } , uO : : {name , list (name) } , S : : set) 
local n, xx, i, vX, vpsi, lpsi, H, CL, lphi; 
unassign( 'T' ) ; unassign( 'X' ) ; unassign( 'psi ' ) ; 
n:=nops(xO) ; 

if n>l then lphi:=phi; lpsi : = [seq(psi [i] , i=l . .n)] ; 
else lpsi:=[psi]; lphi:=[phi]; fi; 
xx:=op(xO) ,op(uO) ,op(lpsi) ; 
vpsi : =Vector [row] (lpsi) ; 

if n>l then vX:=Vector( [seq(X[i] , i=l..n)]); else vX:=Vector( [X] ) ; fi; 
H : =psi_0*L+vpsi . Vector(lphi) ; 
CL : =vpsi . vX-H*T=const ; 
CL:=eval(CL, S) ; 

CL:=subs({map(i->i=i(t) , [xx] ) []},CL) ; CL : =subs (psi_0=psi [0] ,CL) ; 
return CL; 
end proc: 

7 Concluding Remarks 

Computer Algebra Systems are particularly suitable to handle the problem of determining 
symmetries and conservation laws in optimal control, because theory requires calculations 
that tend to be tedious even for very simple problems with a linear control system. Maple 
can perform these computations in a reliable way. We illustrate our package by a large 
number of examples, that range from simple problems in the calculus of variations to 
optimal control problems of which the integrability was only very recently shown by means 
of the conservation laws. Now these computations can be made in a completely automatic 
way and without any physical insights. 

In mechanics, and calculus of variations, it is well known how to use the conservation 
laws to reduce the order of the problems and, with a sufficiently large number of indepen- 
dent conservation laws, one can even integrate and solve the problems completely. Like 
Noether's theorem, also the classical reduction theory can be extended to the more gen- 
eral setting of optimal control [SJEI]. However, the reduction theory in optimal control 
is an area not yet completed. More theoretical results are needed in order to be possible 
to automatize the whole process, from the computation of symmetries to the maximum 
reduction of the problems. 

As the examples show, the computing times increase exponentially with the dimension 
of the control system (with the number of state variables). This is well illustrated with 
the problems of sub-Riemannian geometry: problem (2,3) (Example ITTj) . with three state 
variables, requires a total computing time of one minute; problem (2,3,5) (Example ITHj) . 
with five state variables, has required us thirty minutes. To tackle more complex problems 
a new approach is needed. This is also under study and will be addressed elsewhere. For 
example, integrability of the (2, 3, 5, 8) problem of sub-Riemannian geometry, a problem 
with eight state variables, is currently an open question. This problem is out of the 
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scope of the present Maple package: eleven hours of computing time in our 1.4 GHz 
Pentium Centrino with 512MB of RAM were not enough to determine the symmetries of 
the problem. 
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